be the death of

phrase

: to cause (someone) to die

I worry that his drug addiction will be the death of him.

—often used figuratively suggesting concern or frustration

Those kids will be the death of me!